Audiovisual integration in
نویسنده
چکیده
The presentation of visual stimuli of moving mouth is known to affect the phoneme perception of the auditory stimuli during natural speech, and provides important insights into the scientific and technological study of speech. In order to investigate the laterality of the audio-visual integration we studied the relationship between the McGurk effect (McGurk and McDonaold 1976) and Right Ear Advantage (REA) in dichotic listening (DL). When visual /ga/ was presented with the dichotic auditory stimuli, both the McGurk effect and REA was observed. On the other hand, when visual /ba/ was paired with the dichotic auditory stimuli, the visual /ba/ strongly affected the proportion of the phoneme perceived. In addition, the phoneme perception in the DL was influenced by the auditory syllables fed into the right ear more than those fed into the left ear. These results suggest that the cortical processes that underlie the McGurk effect is consistent with, and probably shares the same process with, those that lead to REA.
منابع مشابه
The role of emotion in dynamic audiovisual integration of faces and voices.
We used human electroencephalogram to study early audiovisual integration of dynamic angry and neutral expressions. An auditory-only condition served as a baseline for the interpretation of integration effects. In the audiovisual conditions, the validity of visual information was manipulated using facial expressions that were either emotionally congruent or incongruent with the vocal expression...
متن کاملNeural dynamics of audiovisual speech integration under variable listening conditions: an individual participant analysis
Speech perception engages both auditory and visual modalities. Limitations of traditional accuracy-only approaches in the investigation of audiovisual speech perception have motivated the use of new methodologies. In an audiovisual speech identification task, we utilized capacity (Townsend and Nozawa, 1995), a dynamic measure of efficiency, to quantify audiovisual integration. Capacity was used...
متن کاملSuperadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization.
Merging information from multiple senses provides a more reliable percept of our environment. Yet, little is known about where and how various sensory features are combined within the cortical hierarchy. Combining functional magnetic resonance imaging and psychophysics, we investigated the neural mechanisms underlying integration of audiovisual object features. Subjects categorized or passively...
متن کاملSelective Audiovisual Semantic Integration Enabled by Feature-Selective Attention
An audiovisual object may contain multiple semantic features, such as the gender and emotional features of the speaker. Feature-selective attention and audiovisual semantic integration are two brain functions involved in the recognition of audiovisual objects. Humans often selectively attend to one or several features while ignoring the other features of an audiovisual object. Meanwhile, the hu...
متن کاملUncertainty and attention in audiovisual speech perception
This study deals with uncertainty and attention in audiovisual speech perception. Subjects were exposed to audiovisual stimuli where independent variable was bivalent: either blocked to one ear or uncertainty about in which ear the next stimulus would appear. The hypothesis, that uncertainty would inhibit audiovisual integration was motivated by an earlier study (Öhrström et al, 2011) but these...
متن کاملA measure for assessing the effects of audiovisual speech integration.
We propose a measure of audiovisual speech integration that takes into account accuracy and response times. This measure should prove beneficial for researchers investigating multisensory speech recognition, since it relates to normal-hearing and aging populations. As an example, age-related sensory decline influences both the rate at which one processes information and the ability to utilize c...
متن کامل